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TWO-DIMENSIONAL PYRAMID FILTER ARCHITECTURE 

RELATED APPLICATIONS 

This patent application is related to U.S. Patent Application Serial No. 09/754,684, titled 
"Multiplierless Pyramid Filter," filed January 3, 2001 , by Tinku Acharya, assigned to the 
assignee of the present invention and herein incorporated by reference. 

BACKGROUND 

This disclosure is related to pyramid filters. 

In image processing it is often desirable to decompose an image, such as a scanned 
color image, into two or more separate image representations. For example, a color or gray- 
scale document image can be decomposed into background and foreground images for 
efficient image processing operations, such as enhancement, compression, etc., as are at 
times applied in a typical photocopying machine or scanner device. In this context, this 
operation is often referred to as a descreening operation. This descreening is also sometimes 
applied to remove halftone patterns that may exist in an original scanned image. For example, 
hese halftone patterns may cause objectionable artifacts for human eyes if not properly 
removed. The traditional approach for this decomposition or descreening is to filter the color 
image in order to blur it. These blurred results are then used to assist in determining how 
much to blur and sharpen the image in order to produce the decomposition. Typically this 
blurring can be achieved using a "symmetric pyramid" filter. Symmetric pyramid finite impulse 
response (FIR) filters are well-known. 
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One disadvantage of this image processing technique, however, is that the complexity 
increases many fold when a number of pyramid filters of different sizes are applied in parallel 
in order to generate multiple blurred images, to apply the technique as just described. A brute 
force approach for this multiple pyramid filtering approach is to use multiple FIR filters in 
parallel, as illustrated in FIG. 1 . Such an approach demonstrates that the design and 
implementation of fast "symmetric pyramid filtering" architectures to generate different blurred 
images in parallel from a single source image may be desirable. 

The numbers provided in parenthesis for each FIR block in FIG. 1 represents the 
pyramid filter of corresponding length. For example, (1,2, 1) are the filter coefficients for a 
symmetric pyramid finite impulse response (FIR) filter of order or length 3. Likewise, (1 , 2, 3, 
2, 1) are the coefficients for an FIR pyramid filter of order 5, and so forth. 

Unfortunately, the approach demonstrated in FIG. 1 has disadvantages. For example, 
inefficiency may result from redundant computations. Likewise, FIR implementations 
frequently employ multiplier circuits. While implementations exist to reduce or avoid the use of 
multipliers, such as with shifting and summing circuitry, that may then result in increased 
clocking and, hence, may reduce circuit through-put. A need, therefore, exists for improving 
pyramid filtering implementations or architectures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Subject matter is particularly pointed out and distinctly claimed in the concluding portion 
of the specification. The claimed subject matter, however, both as to organization and method 
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of operation, together with objects, features, and appendages thereof, may best be 
understood by reference of the following detailed description when read with the 
accompanying drawings in which: 

FIG. 1 is a block diagram illustrating a brute force approach to implementing a finite 
impulse response (FIR) multiple pyramid filtering architecture; 

FIG. 2 is one embodiment of a one-dimensional multiplierless pyramid filter; 

FIG. 3 is one embodiment of a two-dimensional pyramid filter architecture; 

FIG. 4 is a table/matrix showing an example of a matrix that may result from 
implementing a two-dimensional pyramid filter architecture, such as one that may be 
implemented by the embodiment of FIG. 3; 

FIG. 5 is a table/matrix showing an example of a two-dimensional signal that may be 
operated upon by a two-dimensional pyramid filter architecture; 

FIG. 6 is a table/matrix showing an example of applying a one-dimensional pyramid 
filter kernel both row-wise and column-wise; 

FIG. 7 is the table/matrix of FIG. 6 for k=9; 

FIG. 8 is a table/matrix showing the result of applying a one-dimensional pyramid filter 
to the rows of a two-dimensional input signal sample matrix; and 
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FIG. 9 is a table/matrix showing the result of applying a one-dimensional pyramid filter 
to the columns of a two-dimensional input signal sample matrix. 

DETAILED DESCRIPTION 

In the following detailed description, numerous specific details are set forth in order to 
provide a thorough understanding of the claimed subject matter. However, it will be 
understood by those skilled in the art that the claimed subject matter may be practiced without 
these specific details. In other instances, well-known methods, procedures, components and 
circuits have not been described in detail in order so as not to obscure the claimed subject 
matter. 

As previously described, pyramid filtering, in particular, symmetric pyramid filtering, may 
be employed in connection with color images or color image processing in order to decompose 
or descreen the image, such as into a background and foreground image, for example. 
Although the claimed subject matter is not limited in scope in this respect, in such a context, 
pyramid filtering architectures that reduce computational complexity or processing and/or 
hardware cost are particularly desirable. Likewise, implementations that are multiplerless, that 
is do not specifically employ multiplication in the implementation, are also desirable usually 
because such implementations or embodiments are cheaper to implement than those that 
employ or include multiplier circuits. 

Although the claimed scope is not limited in scope in this respect, FIG. 2 illustrates an 
embodiment 200 of a one-dimensional pyramid filter, such as described in more detail in 
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aforementioned U.S. Patent Application Serial No. 09/754,684, titled "Multiplierless Pyramid 
Filter," by T. Acharya (attorney docket no. 042390.P1 0722), filed on January 3, 2001 . 
Embodiment 200 comprises a unified multiplierless cascaded symmetric pyramid filtering 
architecture to generate a multiple number of filtered output signal streams for a series or 
sequence of pyramid filters having different orders, the generation of the output signal streams 
occurring in parallel. In this particular embodiment, although, again, the claimed subject 
matter is not limited in scope in this respect, a filtered output signal stream is produced on 
every clock cycle for each pyramid filter of a different order being implemented. Therefore, in 
addition to being computationally efficient, this particular embodiment produces good results in 
terms of throughput. However, as previously indicated, this particular embodiment implements 
a one-dimensional pyramid filter. 

FIG. 2 is understood in the context of specific notation. For example, an input source 
signal, X, may be designated as follows: 

X = (Xo, X-|, ... , Xj-2, Xj-1, Xj, Xj + 1, Xj + 2, ----) 

In digital or discrete signal processing, filtering may be expressed as a convolution, ® , 
of the input signal, X, and a filter, F, in this context a digital filter of finite length, referred to 
here as a finite impulse response (FIR) filter. Therefore, the filtered output signal stream is 
indicated as follows: 

Y = X ® F 
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As previously described, the particular embodiment in FIG. 2 employs pyramid filters. 
These filters are typically implemented using digital filters of lengths or orders that are odd, 
such as 3, 5, 7, 9, etc. Odd numbers or orders, in this context, may be expressed in the form 
2N-1 , where N is a positive integer greater than two, for example. Some examples of such 
digital filters are as follows: 

F 3 = (1,2,1) 

F 5 = (1,2 I 3 > 2,1) 

F 7 = (1,2,3, 4, 3, 2,1) 

F 9 = (1,2, 3, 4, 5, 4, 3, 2,1) 



F M = (1, 2, 3, ... , N, ... , 3, 2, 1) (where, in this context, M = 2N-1) 

For the foregoing filters, the filtered output signals or output signal streams may be 
represented as follows: 



B 3 = X ® F 3 = (b 0 3 , b! 3 , ... , b M 3 , bi 3 , b i+1 3 , 

B 5 = X ® F 5 = (b 0 5 , bA ... , b M 5 , bi 5 , b i+1 5 , 

B 7 = X ® F 7 = (b 0 7 , b/ bM 7 , bi 7 , b i+1 7 , 

B 9 = X® F 9 = (b 0 9 ,b 1 9 b M 9 , bi 9 , b i+1 9 , 



. . . .) result of input signal X filtered by F 3 

. . . .) result of input signal X filtered by F 5 

. . . .) result of input signal X filtered by F 7 

. . . .) result of input signal X filtered by F 9 
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B M = X ® F M = (C bi M bM M , bi M , b i+ r, ....) result of input signal X filtered by F M 



An alternate way to empirically represent these filtered output signal samples is as follows: 



bj 3 = xm + 2xj + x i+1 



bi = Xi-a + 2Xi_i + 3Xi + 2x i+ i + x i+2 

bj 7 = Xi-3 + 2Xj- 2 + 3XM + 4xi + 3x i+1 + 2x i+2 + x i+3 

bi 9 = Xm + 2Xj. 3 + 3Xi- 2 + 4Xj-i + 5xi + 4x i+1 + 3x i+2 + 2x i+3 + x i+4 

Likewise, by introducing what is referred to, in this context, as state variables, the above 
expressions may be re-expressed as follows: 

bi 3 = Xi + Si 3 , where s 3 = x M + Xj + x i+ i 



bj 5 = bj 3 + Sj 5 , where Si 5 = x\. 2 + xn + Xj + x i+ i + x i+2 



bi 7 = bj 5 + Si 7 , where s 7 = Xj. 3 + Xj. 2 + xm + Xj + x i+1 + x i+2 + x i+3 



bj 9 = bi 7 + Si 9 , where s 9 = Xj. 4 + Xi- 3 + Xj. 2 + x M + Xj + x i+1 + x i+2 + x i+3 + x i+4 
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Hence, the desired pyramid filter may be expressed as follows: 
B 3 = X + S3 , where S 3 = (s 0 3 , S1 3 , s 2 3 , . . . , s M 3 , s 3 , s i+1 3 , . . .) 
B 5 = B 3 +S 5j where S 3 = (so 5 , Si 5 ,s 2 5 , s M 5 , s 5 , s i+1 5 , ...) 

B 7 = B 5 + S 7 , where S 7 = (s 0 7 , s/ , s 2 7 Si-i 7 , , s i+1 7 , . . .) 

B 9 = B 7 +S 9 , where S 9 = (s 0 9 , s^.sa 9 , .... s M 9 , s 9 , s i+1 9 , ...) 



A study of FIG. 2 illustrates that the computed output signal streams, B 3 , B 5 , B 7 , B 9 , etc. 
of the pyramid filters shown in FIG. 2 are produced by the embodiment illustrated. 



The previous discussion of pyramid filters occurs in the context of one-dimensional 
filtering; however, due at least in part to the symmetric nature of such filters, it is possible to 
implement pyramid two-dimensional filtering instead of computing in a row-wise and column- 
wise one-dimensional fashion that employs extra computational steps. If we represent the 



one-dimensional k -tap pyramid filter as F k = 



1 2 3 - — - 3 2 1 



the 



corresponding two dimensional pyramid filter F fai may be derived as shown in FIG. 6. In FIG. 
7, we have shown the two-dimensional pyramid filter kernel for k=9. Assuming a two- 
dimensional input signal, e.g, signal samples, having the form shown in FIG. 5, FIG. 4 is a 
table illustrating a matrix that may result, here a two-dimensional filtered signal sample output 
matrix, P kxk , in which the two dimensional input signal sample matrix is filtered using two- 
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dimensional pyramid filter kernel F t 



kxk > 



The matrix shown in FIG. 8 may result from applying a one-dimensional k-tap pyramid 
filter in every row of the two-dimensional input signal sample matrix and the matrix shown in 
FIG. 9 may result from applying a one-dimensional k-tap pyramid filter in every column of the 
two-dimensional input signal sample matriz. The matrix in FIG. 4 may result from applying the 
two-dimensional (k x k) tap filter to the two dimensional input signal sample matrix or, 
alternatively, it may result from applying the one-dimensional k-tap pyramid filter row-wise and 
then followed by column-wise. Applying this approach to generate filtered signal samples 
outputs P 1x3 , P 3x1 , and P 3x3 , produces the following relationships: 



~ s i-l,j + ZSij + S i+l j 



P-f = Vu-i + 2s,-u + *i- u+ i + 2s,- j_, + 4s. . + 2s u+1 + s u1J -l + 2s MJ + s MJ+l 



Likewise, generating filtered signal samples outputs P 1xS , P Sx1 , and P 5x5 , produces the 
following relationships: 



Pif = S.--2J + 2s w , j + 3s,- j + 2s i+1J + s U2J 
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PIT = s U-2 + 2s i,H + 3s U + 2s UM + s iJ + 2 

Hf = (Si-2j-2+2Si-2j-i + ^ i _ 2J +2s i _ 2J , 1 +s i _ 2J+2 ) + (2s i _ lJ _ 2 +4s i _ w _ 1 +6s i _ 1J +4 Si _ 1J+1 +2s ; _ w . 
(3s,,,._ 2 +6$,.^ +9s iJ +6s tJ+1 +3s tJ+2 ) + (2s MJ _ 2 +4s M , M +6s MJ +4s MJ+1 +2s MJ+2 ) + 

( S U2J-2 ^^ S i+2J-\ +^i+2j +2S j+2 j +1 +Si+2j+2) 

Mathematical manipulation of these equations produces the following result: 

"t Equation [1 ] above illustrates that a direct two-dimensional pyramid filter architecture of 

-s order 2N-1 , in this case where N is three, may potentially be implemented using either four 
y two-dimensional pyramid filters of order [2(N-1 )-1 ] or one two-dimensional pyramid filter of 
3 order [2(N-1 )-1 ] using four signal sample matrices P^ rl , +1 , P,lZ-\ » and tw0 one_ 
dimensional pyramid filters of order 2N-1 , here row-wise and column-wise, in this example. 
FIG. 3 is a schematic diagram illustrating such an embodiment, although, of course, the 
claimed subject matter is not limited in scope to this particular implementation or embodiment. 
For example, the output signal samples corresponding to those produced by four two- 
dimensional pyramid filters of order 2N-1 , here order five where N is three, may not 
necessarily be produced by two-dimensional pyramid filters. As just one example, these output 
signals may be produced using one-dimensional pyramid filters. One such filter is shown in 
FIG. 2, although, again, additional approaches to producing the output signals for the 
architecture shown in FIG. 3 may also be employed. 
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FIG. 3 illustrates an integrated circuit (IC), 300, although, of course, alternative 
embodiments may not necessarily be implemented on a single integrated circuit chip. IC 300 
includes a two-dimensional pyramid filter architecture of an order 2N-1 , where N is a positive 
integer greater than two, here three. This two-dimensional pyramid filter architecture of order 
2N-1 , or order five here, in operation, is capable of producing, on respective clock cycles, at 
least the following. Pyramid filtered output signals are produced corresponding to output 
signals produced by two one-dimensional pyramid filters of order 2N-1, again, five in this 
example where N is three, 330 and 340 in FIG. 3. Pyramid filtered output signals are also 
produced corresponding to output signals produced either by four two-dimensional pyramid 
filters or one two-dimensional pyramid of order [2(N-1) - 1] or three here, where N is three, 
using signal sample matrices P i !S_ P P 1 !; 3 ;+1 ,/ , ,'f ; _ 1 ,F,!£ +1 • These output signals are summed 
by adder 310 in FIG. 3. Likewise, the respective output signals in this two dimensional 
pyramid filter architecture implementation, in the implementation in FIG. 3, for example, the 
output signals of 310, 330 and 340, are summed on respective clock cycles of the two 
dimensional pyramid filter architecture, by adder 320 in FIG. 3. Of course, FIG. 3 is just one 
possible example of an implementation and the claimed subject matter is not limited in scope 
to this or to another particular implementation. 

For example, N is not limited to three. Likewise, the pyramid filtered output signals that 
correspond to output signals produced by a two-dimensional pyramid filter are not limited to 
being implemented by one-dimensional pyramid filters or to two-dimensional pyramid filters. 
Likewise, as previously indicated, if one-dimensional filters are employed, then the filters are 
not limited to the implementation approach described in aforementioned U.S. Patent 
Application Serial No. 09/754,684, titled "Multiplierless Pyramid Filter," filed January 3, 2001, 
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by Tinku Acharya. For example, one-dimensional pyramid filters other than multiplierless 
pyramid filters may be employed. Likewise, depending on the implementation, different 
numbers of such pyramid filters and different orders of such pyramid filters may be employed. 
For example, the output signals may be combined or processed in a way to produce pyramid 
filtered output signals corresponding to pyramid filters of a different number, dimension, or 
order. 

It will, of course, be understood that, although particular embodiments have just been 
described, the invention is not limited in scope to a particular embodiment or implementation. 
For example, one embodiment may be in hardware, whereas another embodiment may be in 
software. Likewise, an embodiment may be in firmware, or any combination of hardware, 
software, or firmware, for example. Likewise, although the invention is not limited in scope in 
this respect, one embodiment may comprise an article, such as a storage medium. Such a 
storage medium, such as, for example, a CD-ROM, or a disk, may have stored thereon 
instructions, which when executed by a system, such as a computer system or platform, or an 
imaging system, for example, may result in an embodiment of a method in accordance with 
the present invention being executed, such as an embodiment of a method of filtering or 
processing an image or video, for example, as previously described. For example, an image 
processing platform or an imaging processing system may include an image processing unit, a 
video or image input/output device and/or memory. 

While certain features of the invention have been illustrated and described herein, 
many modifications, substitutions, changes and equivalents will now occur to those skilled in 
the art. It is, therefore, to be understood that the appended claims are intended to cover all 
such modifications and changes as fall within the true spirit of the invention. 
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